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ABSIBiCT 

Ihis^ document reports 
contributions of educational research 
Significant research projects, in the 
identified: (1) human developseht and 
equality, ineguality, ^nd human right 
educational administration; (6) educa 
improvement and assessment; and (6) r 
papers acd research projects i-a each 
contributions touch a great number of 
characteristics of leapners, preparat 
longitudinal studies of educational e 
and moral values. The listing offers 
strategies available' to educators and 
strategy for resolving problems. (JD) 



on a ••mini-conference", on the 
in the'past ten years, 
following eight major areas are 

learning; (2) 'Reaching; (3) 
s; (4) educational finance; (5) 
tional technology; (7) program 
esearch methodology*. Specif ic 
Of th^se areas are cited. The 

topical areass* such as 
ion of professionals, . 
f fects, educational objectives, 
a range of problem-solving 
the appropriateness of each 
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PREFACE 



Educators' attitudes tovvard, and in suppoft 'of, reseajrch have 
changed markedly in the past decade At the start of that period 
the' situation was almost overwhelmingly positive At its^ conclu- 
sion the attitude has become very negative, frequently expressed 
m a deniai'that research makes j/jjv' contnbution to education. To 
counter that attflude a '*mmi-conference" on research contribu- 
tions was scheduled in advance of Phi Delta Kappa's Thirty- 
fourth Biennial Council That mini-conference identified and 
discussed research contnbutions to education in the past ten 
years 

*The reactions of the participants in the fnini-c on fe rente and 
inquires related to a transcript of the proceedings havel^d to the 
printing of this Occasional Paper The major presenters in the 
mini-conference assisted in^ the preparatiorl of this manuscript 
They* deserve major credit for any contribotions it may make 
Inadequacies in it of any form are the responsibility of this 
wnter With that in mind, a large portion of appreciation is herein 
accorded to Drs Berhe Fallon, Anton J Netusil, and William K 
P0Ston,Jr 
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, THE MOST SIGNIFICANT 
EDUCATIONAL RESEARCH CONtRJBUTIONS^ ^ 
OF THE PAST T^N YEARS 



Research in education has witnessed a swing of the pendulum 
of acceptability during the past decfde At the 'Start of^that 
period, research was blessed with a halo that was of nearly 
blinding brilliance, Jacques Barzun, captured this^ttitude toward 
j'ese'arch as he wrc^ 

History record^ no precedent to this extraordinary adula- 
tion of research unless it be that of the Middle Ages to 
.pilgrimage When it prevailed, 1 'doub^ if anyone who was 
impelled to save his scKil by agoing to a distant shririe was 

^ ever restrained by his friends He would take off his shoes, 
pick up his stick, and go forth with everyone's blessing, just 
as today the research-bent abancions his occupation, picks 
up a box of ihdex cards, and is on his way with shining eyes 
and a two-year grant amid general admiration The very 

, please ''do research^' shows that it is the act. not the goal, 
that matters, and though not many think of research js ' 
savmg their ^ouls. society at large does Believe that there is 
salvation m it (Barzun. 1-964) 

At the* other end of the decade and the pendulum swing, the 
attitude toward research is one characterized by jphn Brademas 
as he said. 

^ many members of Congress are not really clear abcfut' 
what research \n education is and, whatever it is, are not 
sure that* research mak6s any difference in improving 
teaching and learning (Brademas, 1973) * 

Many practicing educators, share the opinion attributed to 
Congressfien To them educational research is, at best, of 
doubtful utility^ and, at worst, aMVaste of scarce resources 

In an effort to move this acceptability pendulum back toward 



."the mfckilt, a ^lini-Confe^eftce focused on 'The Most Significant 
. ContrfSuiioas of Educational Research During t)ie Past, Ten 

Year^"-was^ scheduled as a presession to Phi Delta Ka{Jpa'sU4th 
" Bie^rfral Council pnd First Annual Conference on ^Bducation^ 

Issues (Houston. 1973) * , ' 

> ^ Three educators With d'lfferent backgrounds and ed^ucationaJ 
positions wer^^sked' to^ idontify the research work of the past 
decade tF^at resulted in significant contributions to the field They 

» W^re dii'ected to ufe whatever means they considercid appigpnate 
to determine their nominations Procedur^ suggestions were^ 
made regarding the possibility >Df, a survey, the use of fheir 
professional experiences and study over the past decade, the 
changes in eduLational operations they had observed dunng the 
decade, etc* Although the initial request asked that they identify 
the ten most significant contributions^, the number ten was not a 
hard and fast standard 

^ In the invitation to participate, it was suggested that signifi- 
cant contribution^ did not result from in individual research 
^project Rather it is likely that some critical mass of research 
findings must be accrued before significant contributions 'are 
realized 

Tlfe three parinipants and their background we're 
Dr ATiton J Netusil, Iowa State University. Department ofi . 
Educational Psychology (l^istructional responsibilities in tt»e areas 
of statistics, measurement, -research design, and evaluation) 

' Dr William IC Poston Jr , Assistant Superintendent, Educa- 
tional Services Mesa Public Schools. J^sa, Arizona 

Dr Berlie Fallc^n. Texas tech^lJniversify , Associate Dean for 
Graduate Studies, College of Education. Texas Tech University 
(Former^ly Ixecutive Secretary. West Texas Scho()l Study Coun-^ 

Cll) ' ^" 

Different approaches we/e taken by the three presenters in the 
conference, both in the manner "in. which they- identified 
ilnportant contributions ruade by research, and in therr means of 



illustrating those contributions in thf latter area two* of theifi 
cited specifit studied as tllustVative of lh\ type .of contribution 
made. The third presenter cjted genera)^ topicf, m effe<»;l, brief 
syntheses of many individual studiese^wl^ch |iave been combined 
during the past^ decade in a way thaWias been extremely 
beneficial to educa|ion In all. t%enty-three specific itudies'or 
topics were presented. Those twenty-three iteras ♦have^t:Aome 
commonalities which make' it poss4t)lc to group them in clusters 
as shown below The order of presentation *of these clusters 
should not be considered as an effort to rahk them in terrfis of 
importance bach of the three presenter^ recognized that a 
ranking would ixily be possible il a common value svstem anO^a 
common set of educational needs exist 
'a i 
The 'categories <ff researcii contributions thus identified and 
the illustuttv^ studies are ^ 

.HUMAN DEVELOPMENT AND LEARNINQ ^ ^ 

Stability and Change in ifunuin Charac tcristics Bloom, Ben)amin, 
New York, Wile> \')bS 

An especiall> noteworth> compilation and interpretation ot 
available longitudinal studies on factors related to human 
behavior A must for all researchc^rs in the field of education The 
review of this mass of research leads Bloom to hypothesize that at 
the p4)int of greatest rate of change on some human cha^cter- 
ispc, related educational efforts have th^ir highest payoff This 
hypothesis leads Jlo the conclusion that'more resources'should be 
concentrated at the elementary level than other levels of the 
education system 

Th^ American High School Student The Identification. Develop- 
ment, and^ Utilization of Human Talents Flanagan, John et* a! , 
Pittsburgh, 1%4 Project Talent Office 

C«ooperative Research Project 63e The major objective of the 
pverall TALtNT Study was to determine whicfi educational 
experiences best prepare students for their life work and what 
factors influence young people in choosing careers Researchers 
also helped tp find o^t what paUerns of ability and personality 
have a bearing on succeis and achievement in life A fifrther 
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objective wa^^ compilation of a data bank on ihe , abilities of 
ycfung people ^ 

The inifial project TALENT data were gathered in I960, 
401,000 ninth through twelfth grade studei^ts from more* than 
1,300 high ^schools were surveyed These students were again 
qOestioned one year after completing'high school and five years 
later to determine the extent of their additional education, its 
value to them, an(Ljhe occupations in which they are'^now 
engaged [t is also planned that the students be again surveyed 10 
and 20 years *after graduation from high school to obtain 
additional data tor improving both the guidance and educational 
programs used with the next generation of students 
• 

Findings from this project already have-b^en reported in terms 
'of school size, class size, scholarship requirements, ^nd vocational^ 
^fducation Major deficiencies in educational programs were 
characterized with ;he aim • qf correcting them. To remedy 
deficiencies AIR. the Westinghouse- Learning Corporation, and 
the 14 forward-looking school districts, initiated Project PLAN 
(A Program for LeaFnmg m Accordance with Needs) From 
' Project PLAN a number of modern 'decision-makir\g and oper- 
, ating , procedure* were Reviewed and implemented • such as 
cost-effectiven&ss planning, systems engineenng, and scientific 
research approach ' 
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The Conditions of Learning Gagne, Robert M , New York,Vialt, 
1965 

A lucid and" illuminating discussion of the process of learning 
intended for use m designing better education, this report is based 
on the theo^' that complex forms of learning require simpter 
forms of behavior as prerequisites 

*'Moral Development and MoraNHducatlon " Kohlberg, Lawrence, 
and Turiel, t / in G, Lesser (hd ), Psychology and Educational 
Practice Chicago Scott Foresman, 1 97 1 * 

Kohlberg and his tpllow researchers have continually demon- 
strated the stages and prjnciples of moral development This 
article describes the role of moral education-m the developmental 
process 



Tdxdnomy of Educational Objectives The Qassification of 
Educational Goals Handbook II Affective Domain, Krattwohl, 
David R!, Bloom, Benjamin J , and Masia,^rtram B , I^ew York, 
David McKay Co., Inc., 1964 ^' . 

With Handbook I, the Cognitive^ Domain, this. work has'bein 
discussed as a ''classic'' and a "landmark ^' The two attempt to ' 
bnng i^lder , to our basic '-<;onceptions and work* related tp 
objec#ves that are affective in nature. They provide terminology 
with highly specific definitions,. and structural relationships wUh 
which to relate such objectives Handbook 1! ^pecificail]^ deals 
with the concepts related to the theones of affective develop- 
ment. The^ contributions have led to better designed materials 
for basic skjil development. ♦ 

Sciehtific Creativity Its Recognition and Development Taylor, 
Calvin W , and Barron, Frank, Eds , New York, Wiley, f^63 

A 'collection of 31 research papers from the First. •Second, and 
Third Research Conference on the . Identification of Cre^tiV^ 
Scientific Talent. Discussed is the fundamental nature of scien- 
tific creativity in ari effort to develop means of measuring and 
nurturing it with appropriate educational programs 

Relevance Renewed ^ 

The development of procedures for projecting future educa- 
tional needs and'^a resulting improvement in ability to focus 
problem solving activities to meet those needs has increased the 
contemporariness of eoucation for the learner. The procedures 
referenced are those described iil> the works of the Education 
Policy Research Centers a< Syracuse and Stanford Universities 
They make possible the determination of alternative descnptions 
of the future with information that suggest^tfie nature of changes 
needed to achieve each alternative 

TEACHING 

teacher T^raining and Staff I^evelopment, 

A number of research efforts have contributed to improve- 
rtient of teacher and staff training. These efforts have improved 
the understand^' of th« role of teaching in relation to the 
learning process, improved the ability to develop teachif^ skills 
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'through -nycro-teaching, unproved the evolution of alternafiVe 
method?' for assessing teaching competence, and have given 
greater clarity'of components' of the.te^hmg process. 

77ie Role of the Teacher in the Classrootn % Manual for 
Understandmg and Improving Teachers Classroom BehavK^, - 
Flanders, Ned A . and Amindpn, Edhiynd J . Minneapohs, Paul S 
Ammdon and Associates, 1963 

A description of 'some conditions and tools necessary for 
unders^nding and unproving teacher behavior in the classroon?. i 
Based on the ^ssumptiun that especially through a program of \ 
in-service trainings a teacher can be helped to dehne his ^ own 
concept of desirable teacher behavior and to subsequently modily 
his behavior accordingly 

Schools Without failure Glasser, WiUiam, New York. Harper and 
RoO-, 1969 . ' 

' Dr Glasser, a psychiatfist. outlines strategies providing a much 
greater hkelihood of involving the student in learning experiences 
than those currently in use in most schools Glasser effectivefy 
develops and de*monstrates several major poinB ( 1 /emphasizing 
thinking rathw than memonZatioa can be a powerful motivation 
for youngstei^s to succeed in school, (2) a^reat deal of what is 
ai:tudly part of the child's life at his age per^d should be 
included^ m fhe work of schdol . and , (3 ) the schools should adopt 
those i^ew techniques for involving children in schools that are \ 
already available and mure must be developed, glasser believes - \^ 
that schools. are faiiure-onehted He means failure in the process 
of learnmg.^'oi necessarily failure to pass from one grade to the * 
next Glasser offers operationally sound suggestions for a success 
orientation that will er\gage students m a rewarding pursuit of 
learning ^ . i * 

Pygfnalion in the Classrogm Teacher Expectation and Pupil's 
Intellectual Development % New York, Holt, Rinehart and 
Winston, 1968 

Presents a thesis, based oq experiments conducted m South 
San Francisco and ot^er school distric|^. that the teacher's subtly 
transmitted faith iir tke studen/s ability to succeed is a ' g 
determining factor in the student's actual performaru^e. This 
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book, although Us Siethodology has been se-nously quesTioned, 
raises questions about pupil-teacher rejatignships that cannof be 
Ignored. ^ ' 

EQUALITY INEQUALITY AND HUMAN RIGHTS 

Equality of Educational Opportunity Coleman, James, and 
Campbell, Ernest, Washington, U S. Dept. of Health, Education - 
and Welfar? Offi^ce of Education, 1966. » 
' Equality of Educational Opportunity provides data for deb*at- • 
ing the assumption that i|icTeasing expenditures m low-cost 
schools will enhance educational opporturuties ^The study was 
directed by Cojeman and Campbell \n 1955 and r96(^. ^ata 
collected from a'large sample of schools and5tude^lts suggest that 
differences among American public S|jiools m Olfiss size, b'uild- 
ings, equipment, teacher skilk, library^rvices, and other inputs 
that can be j^asiiy cl]anged by spending mote or less rnone^, 
seemed to have relatively less effect on student success in st^ool 
than does social class T^he CoLenran conclusions are not uruversal- 
ly accepted, however In particular, the type (of averaging ot 
school data in the Coleman analysis is thought bVsoj^e scholars' 
to\minidiize the*effect of 'better school financing on student§ 
learrtiag. ' , 

Inequality A Reassessment of the Effect of Family and 
Schooling in America, New York, Basic Books, Inc., 1972 

This study looks at the effects of family background, years of 
schooling, and IQ scores on adult success. \{ also probes m3ny of* 
today's most troubMng questions c'oncferning tracking, school 
expenditures, the effects of school integration on black and 
white, and other controversial issues Sucn 'conclusions as that, 
schools are incapable of equalizing intellectual achievement and 
are unable to eliminate the social and economic disparity between 
rich and poor or blaci^ and ^hite have lead reviewers to. acclaim 
this book a, "potentially liberating force for Amencan 
education Jencks' conclusions are the result of a three-year 
study by an eight-member Harvard research team supported by a 
$500,000 grant from thg Carnegie Corporation. ^ > 

"How Much Can Boost IQ and Scholastic Achievement " 



-Jensen, A/^ Rk Hdrvard Educational Review. 1968-1969; ^P, . 
iJ-123V,V .'^ . , ^ • • ^ ' ♦ ' . 

'^4iis articie reports the aulhor's findiiyj* that support the claiin 
of intelracial g»netic differences when measunfig IQ, The article- 
, triggered debate of the magnitude of inheritance or environment 
as determiners of jntelhgehc^, the debate has resulteSSn factions 
on either side and has ras^d questic^n^ of the morality 'of'researcb 
^ efforts which 'inv#stigate phenomena of this sort. 

' Humaneness of Education, . . - ' 

Studies of minontx and ethnic groups, the human and civil 

rights and responsibifities of .students and teachers, and explora-^ 
*tion^ »of alternative forms o^f education have contributed to 

education programs » that ' are more i^sponsive to individual 

learners a^fthe quality of their experiences. 

EDUCATIONAL ADMINISTflATlOW 

Preparing Educational Leadership /dr the Seventies Culbertson, 
J , F^rquhar, A. H , Gaynor, A 'K , and Shible* M R>, Columbus, 
Ohio, University Council for EducaSional Administraflon, 1969 

A report of a 1969 UCEA effort setting forth s6r\)e or the . 
more progressive'^conceptualizations and plans f(ir the preparation 
of school administrators. - ^ - • • 

EDUCATIONAl f IN ANCE 
Educational Fmartting Court Cases 

Serrano vs. Freest ^ - ^ 

On August 30^971, the Supreme Court of California decided 
by a majority oAsix to one that the system of Cnanciiig schools in 
the staje through local ' property taxes violates the Equal 
Protection- Claui of' the Foprteewi Amendment tc thf U, S. 
Constitution The Cahfofnia decision raisdd questions about the 
legality of the entire system ^f financinji public education. It 
found that state effprts at equalization are **inadequate.t0 offset'^ 
the inequalities inherent in a financing system Ijased on widely 
varying local t.ax basis.'' 

^ •< _ . ' 

The Western Center on Law and Poverty filed the Serrano Case 
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on behalf of poor people ih Lo^ Angeles^fio we^e concerned 
Jbout inadequate and unfair fTnancing of the pubhc schools in the ^ 
poor neighborhoods The^SerraTio Case is more specifuially 
Serrano vs Priest-Mrs lv>' Baker Priest, Treasurer of Cahfornia 
It might be' more accurate to identify the real defendant as state 
legislature The Superior Court judge agreed with, the state 
defendants tjiat even if the facts wer^ true, ,th^^tu^)n was 
illegal, and the case was dismissed Afu^ j^HH|^Pourt of 
Appeals, which the plaiqtiff ldst77he*^Tipre|^|^MP^Wv^ . 
decided tw hear the case and the court ruled for the plaintift 
parents The 'decision placed the State of California in a legally 
untenable position Its 50-\^ar-()ld scKoal tax sy-^teni had been 
ruled unconstuutionai The decision was reversed by the Mnited < 
States Supreme Courl • ~ ^ * • 

Rodnques Case • - 

.On Decem'ber 23, 1*^>71, the Federal Court ^ir\ San Ant^nio, , 
Jexas, struck down the Texas lav^ .governing the fundi^^^f that 
state's public school s>stem, again bajipg the -decisrqn on a 
violation of the hqual Protection Clause ofthe 14th Amendment 

/ , ' 

Dusartz vs. Hatfield 

In October^oi 1^7 l\ the Federal Sistr^ct Qourt in Mmneapolis 
filed Its op'inion in Dusartz vs Hatfield approving the SejTano 
decision and declaring the Minnesota method of financing its , 
public schools unconstitutionat because it violated the Ex^ual 
Protection Clause of the 14th Amendment 

These three cases have called attention to a crisis of educa; 
tiOnal finance and raise^ senous questions iibout the established^ 
means of furid raising- • tilation *af property. T^ey h^ve also 
provided the impetus for^he search 'for alternative fohns for 
education^ funding ' ^ 

EBUCAIIONAL TECHNOLOGY . ' 

\ ' 

Computer A^iUed Instruction Suppes, Patrick,* et aUj^^Fhe 
1%6-1%7 Stanf(^ Arithmetic Program, New Yofk. Academic^ 
Cress, 1969 

Suppes* writings have continuously demonstrated thf uses of ^ 

' • Li ' 
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computer-assisted instruction Hi^ early work led the way to 
further improv'ements in CAi 

77?^" Evolution of ihe Instructional Product Development Process 
During the decade educators' understanding of the develop- 
ment process hds expanded The creation of tools for domg 
educational work has moved from an unfocused, woefully 
underfunded, erratic class ot operations to one that is modestly 
funded and usuallv carried out in svstematic and pubhc ways 
This has come about through incrdBed funding for educational 
development efforts, ihh laHuences or general systems theory and 
systems analysis, 'and tH^ gradual acquisition and improvement of 
kngwiedge about learning The developments in this area have 
res*jlted. ,fn improved instructional products which make it 
possible to, move trom a tact- focused curriculuni to one that is 
focused more on the processes of learning , 

PROGRAM IMPROVEMENT AND ASSESSMENT 

t ducat lonal Impn > veni en { Prt )fec t The^ First Fi ve Years Atlanta, 
(Georgia /Sou them Association of Colleges and Schools, 1^6^) 

This report describes a six-year effort* to improve education in 
the Southern s^ates The Education Improvement Project (hlP),a 
brainchild of the Southern Association of Colleges and Schools, 
worked toward implementing- the goal of accouritabihty at all 
levels ()f education This report describe^ the origmal prd^ect in 
terms of gi)als and programs It is not a evaluation report ot the 
LIP • , 

?^ A Foundation (rocs to \'hr)(Tl The Ford houhdation Compre- 
hensive School Improvement Program / 960-1 %7() New York, 

This report subtitled, "The Ford Foundation Comprehensive 
School Improvement Program 1^)60-1970. traces and analyzes the 
results of a major Ford Foundation effort throughoutthe 1960*s 
to improve public education was charactecjz^ by the 
,ubjeclive juf ^egiticizmg the ^^offcept of innovaHiun in pubhc 
school programs The report was the product of an independent 
assessment team headed by Paul Nachtigal This valuable docu- 
ment should be useful to historians and educational researchers 



for Its well organized descnption of an effort by one of the 
leading foundations in the United States 

RESEARCH METHODOLOGY 

Methodology of the Educational Research Process Itself 

Marked unprovements have been made during the pjst ten 
years in our tectiriJcal ability to carry out studies on education 
and educative processes Few new techniques have been created 
during the past decade The improvement has come in the form 
of better knowledge abinjt and skills in conducting research More 
individual educators are capable ot performing an analysis of 
variance, regression analysis, multivariate analysis, etc , than was 
the case in earlier decades As a .result the research based 
information added to our generalf/able knt)v^ledg'e has increased 
in^'amount and quahty , 

Access to Research Information ^ 

During the past decade the development of HRIC and the 
numerous ia(()rmation services that make use ol tbe ERIC 
collection make it possible -for any interested educator to acquire 
up-to-date intormation about almost any educational toprc 
Although not a direct contribution of research in education, tlie 
information storage and retrieval systems now make it unaccep- 
table for an educator to remain uninformed on pressrng educa- 
tional problems- 

A SUMMARY THOUGHT 



The above list of nominations for importance as research 
contributions touches a great number of topical areas - character- 
istics of learners, preparation professionals, longitudinal studies 
of educational effects, educational objectives, and moral values, 
to name but a few Underlying the list, however, is a development 
• an advancement of knowledge during the past decade • that 
merits 'recognition .That development encompasses the range of 
problem solving strategies available to educators and the recogni- 
tion of the appropnateness of each strategy for resolving a class 
vf problems This development has at least two roots increased 
understanding of the nature and classes of "problems," and the 
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Solving awareness of similarities AND differences between the 
evaluation, development, and research as problem solving ^trate- 
gies^ ' 

*Troblems" acVprding to McDowell f 1966) have three compo- 
heo*^, fhe^fijst is intention of some sort The second is the 
existence of at ]east*«ne barrier or impediment The third 
co^iponent of any, problem is the connective th^t links a burner 
,^j;jL barriers to .a given intention. Unless alf three of these 
co%iponents.are pfesent,'a problem doesAiot exJSt 

"Problems" can be classified by identifying categories of 
intentions such as intention to know, intention to choose, 
intention to do, intention to manage, etc An intention to know 
becomes a problem when it is determined that the information to* 
*be knpvyn does rrot exist m society's knowledge bank The topic 
either h^ never been studied or those existing studies are 
mconclusive An intention to choose occurs when one is forced to 
select one hi more alternatives from a set for different treatment 
ox action Such an intention becomes a problent when compara- 
tive information about each of- the alternatives is not available 
The intention to do becomes a problem when the tools or 
procedures available ' will not accomplish the task at the le>el 
desired. " ' • 



For each of these categories there is an appropnate solution 
strategy, namely, research, evaluation, and^development During 
ihe past decade some educators have developed the ability to 
analyze^'and classify problems and thus, to select more appropn- 
ate and efficient resolution strategies for their solutions This 
ab?lity, problerri^analysis and resolution strategy selection needs 
1*0 be leajned by tiiore educators during the coming^ears, since it 
IS wjdel>kaccepted that the strategy selected for solving a problem 
materially determines the jT^ture and the quality of the solution 

Educators ^itwt learn that the ' research, process cannot be 
employed to solve all kinds of problems The strategy just is not 
up to the task We' cannot create new instructional tools and 
procedures by application of the research process Research can 
be^ conducted to determine effects of instructional tools and 
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procedures or to gain mfonnation that might be useful in creating 
them. It IS not a strategy for creatmg and/or -inventing the 
vehicles, the tools and procedures, we need to do educational 
tasks By the same token, the research* strategy will not resolve a 
problem "in which an intention to choose is the central' compo- 
nent. The product of research is information which either 
descnbes some population on a specified variable or variables, or 
information which supports or fails to support a conclusion abou* 
the truth of some hypothesis Neither of these outputs is 
sufficient to provide the* comparative information needed to 
?elect from some set of alternatives ^Finally, the evaluation 
process is not sufficient for problems in which an intention to do 
is the central component If no tool exists or if one exists but use 
of It fails to provide the desired output, there is nothing to ' 
compare In such a case a strategy for comparison will not solve 
the problem. 

Two points need to be made in co^iclusion First, these three 
strategies are frequently called for m the resolution of an 
educational problem. Second, the failure to recognize the 
differences among these three solution strategies will lead to 
further erosion of support for research in education 

A project which starts as a solution to an "mtention-to-know- 
problem'' calls for an application of the research pi^ess As that 
effort progresses, it may encounter a situation m Avhich ^ata 
needs require the creation of a new measuring instrument* In such 
a case, an "intention-to-iio-problerri" has been encountered A 
new measuring tool must be created The development process 

* should be utilized until an acceptable measuring t9ol has been 
created and validated When that is, accomplished the project 
retums to the research proce'ss In some research efforts the 
researcher m'aj^'know of several measuring tools for generating ihe 
daia, one of which will be used. In this instance a choice hiust be 

kmade and«the evaluation process should be employed The same 
point can be ma3e regarding projects, which begin as evaluation 
efforts Situations calling for comparison may- also require 
creating measurement tools or the generation of sor^p new 
knowledge necessary in the choice making In those instances the 
project management should recognize that either the develop-. 



ment or research process should be 'employed to resowe the 
immediate probjem, and thus make it possible to continue the 
evaluation effort effectively. And, of course, this'point is/equally 
apphcable to development efforts Developing a specific iool can 
sometimes be stymied for the lack of information pi i certain 
tyi^e in such instances, research to produce th^^ needed/informa- 
tion IS required before the development effort can be el"fectively 
advanced in other situations the developer may encounter two or 
more items that could be used as a component in the /tool he is 
developing Choosing the bestrone requires evaluatijl)n of the 
alternatives Again, the use of these other strategies is purposive - 
to re-solve sub-problems"enc6untered in the resolution of the 
major problem. . j 

Failure to recognize the nature and utility of theise strategies 
Will resujt in major loss of confidence in the utility of research on 
the part of educators, policy makers, and the lay public To some 
extent this has already happened A school system's research 
depkartrftent that provides generahzable informaticfc^ about the 
nature .of reading problems will not satisfy a school Soafd request 
to find ways' of Leeching children to read The research process 
creates 'knowledge, and knowledge seldom, if eve:, does .work. 
Educators have turned to the research process f)i^ systematic 
resolution of all problems for a long time The circuiristances that 
now impinge - tighler money, rapidity of social and technical 
change, and the demand for accountability - call upon educators 
to become more efficiest problem solrers. an efficiency that 
demands our efforts become more purposive ahd responsive 

i 

.Educators at all levels need to learn five things about the 
evaluation, research, and development strategies 

1 What is the general nature of each strategy^ 
a Evaluation is a companson strategy, 
b Research is an analysis strategy 
c •Development is an invention and design strategy » * 
• 2 What IS the nature of the problem for which' each is an 
. 'appropnate resolution strategy*^ 

a. Evaluation • intention to choose one or more alternatives 
from a set/barred by a lack of information which 
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relatively/ weighs each alternative on a /elcvant set of 
catena. 

••b. Research - intention to know 4ome gcneralizable fact or 
• principle/barred by tbeJack of any pnor study of the 

unknown or inconclusiveness of the existing^tudies. 
c Development • intention to do some educational task/ 
^ barred by the hck of tpols or procedures 'for doing the 

work 4J the desi^d fevel 

3 What are the general process components of these 'strate- 
pes'' . , . ; _ 

a. Evaluation has three basic process components. 

^) E)flineating the nature of the needed comparative 
mfofma|ion by describing' tjie alternatives to be 
consid^ed and the criteria to be used in determining 
their relative worth. 

2) Ot^ainmg the necessary datas and through analysis. 
coDvfertmg It to information ' 

Reportmg the information'^ communicatmg to the » 
decision makers. . * 

b. Research h'as.four basic process Components* 

• 1 ) Revifew of what is known to ihaipen cqnjectp'fe about 
* the naPture of the- unknown an(f knowledge^ of th^ 
techniques-for^investiga^g It. 

2) Rephcatirrg the natural' phenomenon with measures 
built in to provide data. 

3) Analysis of the data to confirm "or disconfirm {he 
-4* "truth"' of the conjecture. 

4) Reporting donclu^ons'a^out what is now known. 

c' Development has tour b^ic process components (Clark 
, ^Johnston, 1970) 

1) Determine function, purpose, or mission to be accom- 
phshep.. f " 

2) Design ideal ^stems (oi accomplishing that function.% 

3) Develop optimum' stolutions system best, system 
currently ppsjible for achieving that function. ^ 

• 4) Deliver tfie results - install and o{)erationah2C the 
optimal solution system. - 

4 What are the products of each strategy*^ * 

a. Evakia)tion provides mformation for dcterminmg tfje 
relative viOT\h of a number of alternatives. . 
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b Researc*h provides information about phenomena - state- 
ments of fact or pnnciples - that have general applicabih-v 
ty 'across^space and time * 
' c Development provides working systems for performing 
educational tasks * * . " 
5 Finally, what crHena are useful in assessing the quality of 
an application of each^strategy ' ^ * 
^ a. Evaluation must meet standards of decision relevance, 
timeliness, comprehensiveness, credibility to the c^pciSK^ 
^ makers and cost 

b Research must meet standards of intefnal and external 

v-aJidity-and of replicability 
c Development must meet standards^of function accnrw- 
plishment. cost in creating the product, and involvement* 
of the product users 
s 

When the subtleties of these points are understood, the educator 
can obtain real benefit from the items cited above as the most 
important research contnbutuvis of the past ten years 
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OCCASIONAL PAPERS . , , 

* 1 THE PROBLEM AND PROBLEM DELINEATION TECHNIQUES - 
William J Gephart, Ph/ Delta Kappa Presented at the Second National 
Symposium for Professors of Educational Research, sponsored by Phi 
Delta Kap*pa, Boulder, Colorado. November 21, 1968. A discussion of 
the nature of the concept "problem" as related to educatJonal research 
with a discussion of several techniques useful in problem identification 
and delineation $ 1 00 ' * - 

2 A REVIEW OF INSTRUMENtS DEVELOPED TO BE USED IP^ THE 

. EVALUAtlON'OF THE ADEQUACY OF REPORJE^ RESEARCH 
- Bruce^B Bartos, Phi Delta Kappa& Indiana UniveTsity, Presented at 
th* Annual Meeting of the American Educational Research Associa- 
tion, February, 1969, Los Angeles, California A bjief description and 

' bibliograp-hic annotation of 40 instruments deveToped to be used in 
assessing the methodological quality of completed research $ 25 
^ PROFILING EDUCATIONAL RESEARCH - William J Gephart, Phi 
Delta Kappa. January, 1969 The rati(^frale for the development of a^ 
methodology profUe on completed research to show its »trengt^|s and 
weaknesses l/icluded are flow Charts for profiling the five facets of the- 
r^*4earch*process $ 75 

4 /APPLICATION OF THE CONVERGENCE TECHNIQUE TO READ- ^ 

William j (Gephart, Phi Defter Kappa, January, 1969 An 
mt^im icpor^ on^j research program planning effort in th% field of 
reading (OiAofPnnl^ * . • 

5 THE CON VERGENC£ TECHNIQUE AND READING A PROGRESS 
REPORT -^William J Gephart. Phi Delta Kappa PreseilTH^at the 
Annual Meeting of the International Reading Association, 2, 
1969, Kan*s City, Missoun A second Interim report on the planning 
of a reading research program. (Out of Print) - » 

6 THE EIGHT GENERAL RESEARCH METHODOLOGIES A FACET 
ANALYSIS OF THE RESEARCH PROCESS - WiUiam J. Gephart. 
Phi Delta K^appa. July 14, 1969 The identification and description of 
general research ^methods in education through the im of Gutman's 

.^facet design and analysis technique It also details the procedures for 
the Gutman technique This paper was printed in the proceedings of 
the Wartew, Poland Congress of the International Association for the 
Advancement of Educational Research $100 

7 PROFy-ING INSTRUCTIONAL PACKAGE - William J Gephart i 
Bruce B Bartos. Phi Delta Kappa, August, 1969 An instruction text 
to BS5ti»t ifWividuals with no«pnor research training in the \jse of • 
research profiling flow charts to assess the methodological adequacy of 
completed rfiearch $ 1 00 . 

EDUCATIONAL KNOWLEDGE,USE - Gene V, Glass. Laboratory of 
E<Jucational Research, University of Colorado. An analyst of the ^ 
availability and use t)f empirically based information in education. 
, $ 50 

9 MEASUREMENT AND RESEARCH IN THE SERVICE OF EDUCA 
TION - Warren G Findl^y, ^esea'rch and Development Center m 
Educational ^timu1l1ft>n/ Ugryersity of G.eorgia. Origihally presented as 
*an invited address at the annual meeting of the American Educational 
Research Association, this paper use« an historical perspective to^ 
examine the role of measuremelK and research in education. S,75 
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nU^JDl'C MK;NAL t M ALYSI ANIMIMKAIIM lOKlOPAV 
Joe H jr Kee^e Love jnd (ieorge M Higjtuison SoulhwesI 

" IduLjJion'jl l)^%eli)pment Labrffatorv Austin Fexjs Julv, 1^7 1 An 
jnjlvsis ot >ttie problems* involved m the^ process of itiange jrfd , 
improvement »»t tlie prjLtKe ot eduLJtion^ fhis paper poses j new 
protessioiul speualitv t?>r the faulitJtion of cmpirkally ba>ed eUuLj 
tiofial improvements S I 00 
tl plSSl K I \ I U JNS V Ol M W I() SM VNillunvJ (.ephart 

Vhi Delt.i Kjpp^ ,1^70, A mlKraK'n ot d isserta timi s done ui l^h^ 
uhuh ttKUS-f)n VesejtLh Tratninfi j 2 ^ 
i: MIL DOC'IOKAIF |N*H)ICAIK)N IN (ANAI)\ NeviJIe I 
Ko'H^rtson tonimissfon on Higher h dij(.^<iti«)n Hhi Delia Kappa 1^71 
Ai) Ij'ijlvsis o^ the in^itutntns otfenu^ the clotlorate in tdutatum in 
( jnjda I t>is paper is j L^)mpanh<n fiie^t Ut ,i larmier study ot similar 
mstitutnMi's in ^he I'mted Stales S 7*^ 
I J I HI IMPOKlANt I Ol SI AlISIK M POWi KIN IHlC MION \l' 
Kl Si \K( fi -*john. K Miller and IhomasK Knapp iniversitv ..t 
Ko».hester lien an educational expertnient rtsults in non si^initKjrit 
diftLrerues tan it be sjid that n o d it t e rent f exists ' I his paper dis^ussis 
the iMiKt'pt ttiat must be Tttended to It that qiitstn.n is lo hf 
jUNwered It also^ details the pron-'dure tor deterniin itinn ^t sjmpk 
si/e iieed^l m un exptriment $ 1 2^ ' - 

14 I m ( ( )M)l ( I ()M)l VH (M'M f M tN I ni t \ 1 K )N K Khard h 
St hut/ SV\KI Klu/ationjI Kesejrth and Development - I he pjst 
df^adc tijs dtvet->ptd jujrtrlessot ttu' tools jnd prot edures m i-ded t< . 
perform eduiAitioiut ta^^^s Some hut ir^ui-d that ttu resean li pr( kI-ss 
IS tiu veh/le tor achi^virin that t nd -SLhnt/ irpues that tlu 
lit VI lopiT*w>t process is difterent from ttu research (Trotess in manv 
ii \Xjvs ttiat rued t(f ht understood hv ecluia^irs *^<i 



miportiMi ^^avs ttiat rued t(f ht understood hv eclui^)rs v I n<i . 
MM IM<()1 I SS (fj l>» VhL(y»MhN^ (.erald NadPr and VVilliam / 
(.tpf^trt I hi devjopmtnt ^rottss is t-xaniined troni tive points ot 
vieu ID ihis intirvitvs o} (JeFald Nadkr ( hjirman ot tlie Industrial 
\ n^jiiii L^rin^: Dtpartmenl I nivt-rsitv of VVistonsin Uu«fsti«ms pt.sed bv 
(.ephjrt Hid ttieir distussion examine the central njture (tt the 
prov iss ttu tv pes of problems lor vvhu ti i4* is an apprt)priate resolution 
stritikiv tfit t..wijpom'nt attivilies of ttie dev elopiiu' nt prottss {he 
tv pis of produL tsfesultmK from it ariJ tht criteria that would he used 
in assessing thi qualitv <it a development effort S I '^O 
IHh MOSI SK.ND l( AN I JDl^t XTloNAL Kl SI \ l« H ( ON T Kl 
lU 1 IONS (M ' I in I»ASI J I N YI \KS W ilham J (, ephart I'hi Delta 
Kippi in Lollaboration witfi Berlie I allon Anton J Netusil and 
Uilliam K I'ostoi) Jr Three individuals v>erc asked to identify 
important risearLt) contributions Wark lUu^ identitud is hrietiv 
.umnnn/ed and comments are ni/ide about the hianiier >ri whtifi 
I dui at ion il researi h o\tvht to be looked to bv edm ifors n I 2^ 
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